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Abstract 

This paper considers the problem of routing packets across a multi-hop wireless network while ensuring throughput 
optimality. One of the main challenges in the design of throughput optimal routing policies is identifying appropriate and 
universal Lyapunov functions with negative expected drift. The few well-known throughput optimal routing policies in the 
literature are constructed using simple quadratic or exponential Lyapunov functions of the queue backlogs and as such they do 
not use any metric of closeness to the destination. Consequently, these routing poUcies exhibit poor delay performance under 
many network topologies and traffic conditions. 

By considering a class of continuous, differentiable, and piece-wise quadratic Lyapunov functions, this paper provides a 
large class of throughput optimal routing policies. The proposed class of Lyapunov functions allow for the routing policies to 
control the traffic along short paths for a large portion of state-space while ensuring a negative expected drift, hence, enabling the 
design of routing policies with much improved delay performances. In particular, and in addition to recovering the throughput 
optimaUty of the well known backpressure routing poUcy, an opportunistic routing policy with congestion diversity is proved 
to be throughput optimal. 

I. Introduction 

Opportvmistic routing for multi-hop wireless ad-hoc networks has seen recent research interest to overcome deficiencies 
of conventional routing [l]-[5]. Opportunistic routing mitigates the impact of poor wireless links by exploiting the broadcast 
nature of wireless transmissions and the path diversity. More precisely, the routing decisions are made in an onhne manner 
by choosing the next relay based on the actual transmission outcomes as well as a rank ordering of neighboring nodes. The 
authors in [5] provided a Markov decision theoretic formulation for opportunistic routing. In particular, it is shown that for 
any given packet and at any relaying epoch, the optimal routing decision, in the sense of minimum cost or hop-count, is to 
select the next relay node based on an index. This index is equal to the expected cost or hop-count of relaying the packet 
along the least costly or the shortest feasible path to the destination. Furthermore, this index is computable in a distributed 
manner and with low complexity using a time-invariant probabilistic description of wireless links and the time-invariant 
transmission costs or transmission times. As such, [5] provides a unifying framework for almost all versions of opportunistic 
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routing [l]-[3], where the variations are due to the authors' choices of costs; e.g. for ExOR [3], the cost to be minimized 
is the expected hop-counts (ETX). 

When multiple streams of packets are to traverse the network, however, it might be necessary to route some packets along 
longer paths, if these paths eventually lead to hnks that are less congested. More precisely, and as noted in [6], [7], the 
above opportunistic routing schemes can potentially cause severe congestion and unbounded delays (see examples given in 
[7]). In other words, these routing schemes are said to fail to stabihze otherwise stabilizable traffic. In contrast, it is known 
that a simple routing policy, known as backpressure [8], ensures bounded expected total backlog for all stabiUzable arrival 
rates. Most interestingly, this routing poUcy provides throughput optimality without knowledge of the network topology 
or the traffic rates. In the opportunistic context, diversity backpressure routing (DIVBAR) [6] provides an opportunistic 
generalization of backpressure which incorporates the wireless local transmission diversity. 

Note that to ensure throughput optimality, backpressure-based algorithms [6], [8] do something very different from [l]-[5]; 
rather than any metric of closeness to the destination (or cost), they choose the receiver with the largest positive differential 
queue backlog (routing responsibility is retained by the transmitter if no such receiver exists). This very property of ignoring 
the cost to the destination, however, becomes the bane of this approach, leading to poor delay performance (see [6], [7]). 
In [7], the authors proposed a routing poUcy, known as Opportunistic Routing with Congestion Diversity (ORCD) with an 
improved delay performance. ORCD combines the congestion information with the shortest path calculations inherent in 
opportunistic routing [7]. The throughput optimality of ORCD was conjectured in [7] but was left unproven, due to the 
difficulty of identifying appropriate (and universal) Lyapunov functions with negative expected drift. In fact backpressure 
[8] and its variants [6], [9]-[ll], with quadratic Lyapunov function, and randomized strategies [12] with an exponential 
Lyapunov function remain to be the only known throughput optimal routing policies. The strict schur-convex structure 
of these Lyapunov functions, however, are such that their negative drift is ensured only at the cost of potentially large 
delays. In this paper, we provide a large class of throughput optimal poUcies by considering a class of piece- wise quadratic 
Lyapimov functions. The proposed class of Lyapunov functions allow for the routing policies to control the traffic along 
short paths for a large portion of state-space while ensuring a negative expected drift, hence, enabhng the design of routing 
policies without many of the deficiencies of backpressure-based algorithms. We also specialize our result to recover the 
throughput optimality of two known routing policies, backpressure (already known to be throughput optimal) and ORCD 
(whose throughput optimality only was conjectured in [7]). 

In this paper we assume each network node transmits over an orthogonal channel, so that there is no inter-channel 
interference. Furthermore, we assume that the network topology as well as probability of successful transmissions are fixed. 
These assiunptions allow for a clear presentation of the routing problem and illuminate the main concepts in their simplest 
forms. However, we emphasize that the generalization to the networks with inter-channel interference and variable rate and 
power options follow easily as shown in [6]. In [6]. the price of this generalization is shown to be the centralization of 
the routing/scheduling globally across the network or a constant factor performance loss of the distributed variants. The 
generalization to the case of 1) multi-destination scenario and 2) ergodic time- varying network topology and transmission 
probabilities are believed to be also straight forward but remain as future areas of work. 

We close this section with a note on the notations used. Let [x]^ = max{a;, 0}. The indicator function l{x} takes the 
value 1 whenever event X occurs, and otherwise. For any set 5*, denotes the cardinality of S, while for any vector 
V, \\v\\ denotes the eucUdean norm of v. For any set S, int{S) is the set of all interior points of S. When deaUng with 
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a sequence of sets Ci,C2, . . ., we define C" = U'^^Cj. Lastly, we use bold letters to discriminate vectors from scalar 
quantities as well as their components. 

II. PROBLEM FORMULATION AND OVERVIEW OF THE RESULTS 

A. Problem Setup 

We consider a time slotted system with slots indexed by f e {0,1,2,...} where slot t refers to the time interval \t,t + l). 
There w^e N +1 nodes in the network labeled by := {0, 1, . . . , N}, where node is assumed to be the destination. 

Let random variable Ai{t) represent the amount of data that exogenously arrives to node i during time slot t. Arrivals 
are assumed to be i.i.d. over time and bounded by a constant A^ax- Let Aj = E[Ai(t)] denote the exogenous arrival rate to 
node i. We define A = [Ai, A2, . . . , Ajv] to be the arrival rate vector. We assume packets that arrive exogenously at node i 
as well as packets routed to node i from other nodes are queued at node i in a buffer with infinite queuing space. Let Qi{t) 
denote the queue backlog of node i at time slot t. We assume any data that is successfully deUvered to the destination will 
exit the network and hence, Qo{t) = for all time slots t. We define Q{t) = [Qi{t),Q2{t), . ■ ■ , Qjv(i)] to be the vector of 
queue backlogs of nodes 1,2, ... ,N. 

We assume each node transmits at most one packet during a single time slot. Let Si{t) represent the (random) set of 
nodes that have received the packet transmitted by node i at time slot t. We refer to Si{t) as the set of potential forwarders 
for node i. Each node that receives a packet, sends an acknowledgment over a reUable control channel. Hence, we assume 
that node i has perfect knowledge of Si{t). Due to a perfect recall at any node i, we assume i G Si{t) for all time t.We 
characterize the behavior of the wireless channel using a probabiUstic local broadcast model [5]. The local broadcast model 
is defined using conditional probabiUties P{S\i) := Prob({5i(t) = S when i transmits a packet at time t}), S C Cl, i e. Cl. 
Note that, by definition, for all 5 ^ S', successful reception at S and S' are mutually exclusive and '^scn ^("^N) — ^■ 
Node j is said to be reachable by node i (we write i — > j), if there exists a set of nodes S C fl such that j G S and 
P{S\i) > 0. 

We define a routing decision {t) to be the number of packets whose relaying responsibiUty is shifted from node i to 
node j during time slot t. Note that {€) forms the departure process from node i, while it is an element of the endogenous 
arrival to node j, and hence, 

N 

iiij{t) e {0,1} , i^,j{t) < i{jes.(t)} . - ^- 

3=0 

If Mij(i) = 1. then node i retains the packet for future retransmissions. Without loss of generaUty, we assume that after a 
packet is successfully received at the destination, the packet would not be (re)transmitted by any other node, i.e. Hioit) = 1 

if e Si{t). 

For a set C of nodes, we define Ac{t) = Ejec^»(*)' Qc{t) = Ejec<3»W' l^cMt) = Y^j^cY^kec Hk{t)^ and 
IJ-Coutit) = J2jecT,k(cl^3kit)- 

The selection of routing decisions together with the exogenous arrivals impact the queue backlog of node i, i Gfl, in the 
following manner: 
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Definition. A routing policy is a collection of routing decisions Uj^gQ U^q {f^iji^)} where for all and 6 G {0, 1}, 

the decision {fJ,ij{t) = 9} belongs to the cr-field generated by Uij^Q{Qi{0) , Si{0) , fiij{0) , . . . , Qi{t — l),Si{t — l),fj,ij{t — 
l),Qi{t),Si{t)}. 

Definition. A routing policy 11 is said to stabilize the network if the time average queue backlog of all nodes remain finite 
when packets are routed according to 11. The stability region of the network is the set of all arrival rate vectors A for which 
there exists a routing policy that stabiUzes the network. 

Definition. A routing policy is said to be throughput optimal if it stabihzes the network for all arrival rate vectors that 
belong to the interior of the stabihty region. 

Fact 1. ( [6, Corollary 1]) Let 6 denote the stability region of the network. An arrival rate vector A is within the stability 
region 6 if and only if there exists a stationary randomized routing policy that makes routing decisions {A<ij(i)}i,j6n, solely 
based on the collection of potential forwarders at time t, {Si(t)}t^n, and for which 
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In this paper we are interested in a class of routing poUcies which are throughput optimal but do not require knowledge 
of arrival rates. 



B. Priority-Based Routing 

In this section we introduce the class of priority-based routing poUcies. To define the priority-based routing policy we 
need the following definitions. 

A rank ordering R = (Ci, C2, • . • , Cm) is an ordered list of non-empty sets Ci, C2, . . . , Cm (1 < ^ < N), referred to as 
ranking classes, that make up a partition of {1, 2, ... , N} (all nodes except the destination node), i.e. uflj^Ci = {1,2,..., N} 
and Ci O Cj ~ 9, i ^ j. We denote the set of all possible rank orderings of {1,2,..., N} by TZ. Note that when C/s are 
singleton, R reduces to a simple permutation of the nodes {1,2,..., N}. Given a rank ordering R — (Ci, C2, . . . , Cm), 
we write a & to indicate that node a £ Ci has a lower rank than b G Cj, i < j. And we write a 6, if a 6 or 
a,b £ Ci for some i. 

Definition. A priority-based routing policy Yl^nf^f^y is a routing pohcy under which node i, at time time t and among its 
set of potential forwarders Si{t), selects a node with the lowest rank according to R{t). In other words, under H^n^f^y, 
Hij{t) = 1, only when j e Si{t) and j fc for all fc e Si{t). 

Next we give a few definitions which allow us to compare rank orderings R and R': 

Definition. Let R = (Ci, C2, . . . , Cm) and R' = (C( , C2, . . . , C'j^,). We define a mismatch ruf :^Zx^Z—^Nas 

mf{R, R') = min {z e N : Ci 9^ C-} . 

For two rank orderings R and R', mf{R, R') compares ranking classes of R and R' from low to high and determines the 
index of the first ranking class in which they differ. 
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Definition. Given two rank orderings R and R', we say R' is a refinement of R (and i? is a confinement of R') if i j 
implies that i j for any i,j £ il. 

Definition. Given two rank orderings R — (Ci, C2, . . . , Cm) and R' = (C( , C2, . . . , C^^^j^), we say R' is a one-step 
refinement of i? (and i? is a one-step confinement of i?') with regard to ranking class Ci (1 < « < M) if 

Cfc = if 1 < fc < i - 1 

Ci = C[ U Cj'^]^ 

Cfc = C^+1 if i + 1 < fc < Af 
The union of the sets of all one-step refinements and one-step confinements of R, denoted by Bi{R) and B2{R) respectively, 
is referred to as adjacency of R and is denoted by A{R). 

Next we introduce a class of priority-based routing policies under which R{t) is chosen as a time-invariant function of 
Q{t), i.e. there exists a function tt : M.^ TZ such that R{t) ~ Tr{Q{t)). In section II-E we proceed to establish the 
throughput optimality of this class of routing policies. 

C. f -policy 

In this section we introduce a class of priority-based routing policies each of which is associated with a bivariate function 
/, hence referred to as an /-policy. Each such policy partitions the space of queue backlogs, M.^, into \R.\ routing decision 
cones. The specific shape of each cone (and the set of its defining hyperplanes) is dictated by the corresponding function / 
and to each cone a unique rank ordering of nodes R E TZ is assigned. Now define the mapping tt/ : M.^ — TZ such that 
at any time t and for all Q{t) in the cone associated with R, TTf{Q{t)) — R. In order to give the precise description of 
/-policy, we need the following definitions. 

Definition. Given a bivariate function /, a penalty function A/ is defined on backlog vector Q E M.^, rank ordering 
R — (Ci, C2, . . . , Cm) G T^, and natural number n, n < M : 

n 

AXg,i?,n) = ^/(|C^-i|,|C,|)Qc.- 

1=1 

Definition. Consider two rank orderings R and R' and a bivariate function /. We say R penalizes Q less than R' and write 
R <Q R' if 

. Af{Q,R,mf{R,R')) < Af{Q,R',mf{R,R')) 
or if 

• Af{Q, R, mj:{R, R')) = Af{Q, R',mf{R, R')) and i? is a one-step refinement of R'. 

Let Df{R), i? e 7^, be a subset of such that for all Q e Df{R) and all R' e A{R), R <q R', i.e. 

Df{R) = {Q eR+ : R <Q R' for all R' e A^R)} . (3) 

Remark Let R and R' be two rank orderings and let rj E M+ be a constant. If R <q R' then R <^q R' . In other words, 
Df{R) is a cone in M^. 



Remark Due to the linearity of Af{-,R,n) and finiteness of A{R), the boundaries of the cone corresponding to rank 
ordering R consists of finitely many hyperplanes of the form 



AfiQ,R,mf{R,R')) = Af{Q,R',mf{R,R')), 



where R' e A{R). 



Lemma 1. Let bivariate function f satisfy the following two conditions 
• (CI) For all m > and rti, 712 > 

1 1 1 



/(m, 711+^2) f{m,ni) f{m + ni,n2) 
• (C2) For all m > and 711,712 > 

f{m, Til) > f{m + ni,n2). 
Then for any Q G M.^, there exists a unique R E TZ such that Q G Df{R). 

Remark By Lemma [T] {Df{R)}ji^Tz forms a partition of R^. Hence, it is meaningful to define a function tt/ 
such that TTfiQ) = R<^ Q £ Df{R). 

Now we are ready to provide the precise definition of /-policy as discussed earlier. 

Definition, /-policy is a priority-based routing policy n{fl.(t-)} where R{t) = 7r/(Q(i)). 
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Example 1. Consider a network of three nodes as given in Fig. 1(a) Let TZ be the set of all rank orderings of {1,2}, and 



f{m,n) = ^^i?r(j^iTzr[^ ■ Fig- 1(b) shows the structure of the cones {Df{R)}ji^Ti. 





(a) A network of three nodes 
Fig. 1. Structure of the cones for a network of three nodes 



(b) Structure of the cones 



Example 2. Consider a network of four nodes as given in Fig. 2(a)| Let TZ be the set of all rank orderings of {1, 2, 3}, and 

3,Ti(-3li_i) ■ Fig. 2(b) shows the structure of the cones {D f{R)}ii^Ti. 



f{m,n) 



By construction, /-policy orders the nodes based only on their queue backlogs using a bivariate function / independently of 
the topological characteristic of the network. In certain cases, this may cause packets to be routed away from the destination 



(a) A network of four nodes 
Fig. 2. Structure of the cones for a network of four nodes 



(b) Structure of the cones 



and hence, results in poor delay performance. In the next section, we introduce a modified version of /-policy, referred to 
as critical f -policy, with an improved delay performance. The main idea behind critical /-policy is that the rank orderings 
are limited to those under which there exists a path from any node i to the destination through the nodes with lower or the 
same rank as i. The precise description of critical /-policy is provided in the next section. 

D. Critical f -policy 

In order to give a detailed description of critical /-policy, we have to define a critical rank ordering. 

Definition. A rank ordering R is referred to as critical if for each node i there exist distinct nodes ji, j2, ■ ■ ■ ,ji such that 
i ^ Jl —> j2 Ji ^ and /„ i for all 1 < n < L 

The set of all critical rank orderings is denoted by TZc and note that TZc C TZ. Let Ac{R) C A{R) denote the set of all 
critical one-step refinements and confinements of R. We define D'j{R), R e TZc, as 

D^fiR) ^ {Q eR+ : R <Q R' for all R' e AdR)} ■ 
Definition. The network is said to be connected if for each node i there exist nodes ji, j2, ■ ■ ■ ,ji such that i ^ ji ^ j2 ^ 

Next lemma renders the set of cones as a partition of M.^. 

Lemma 2. Assume the network is connected. If bivariate function / satisfies conditions (CI) and ( C2), then for all Q G M.'^, 
there exists a unique R G TZ^ such that Q G D'i(R). 
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In other words, {D'j:{R)}ji^Ti^ is the set of cones that partition M.'j^, and it is possible to define a function tt^ : M.^ TZ^ 
such that njiQ) = R ^ Q e D-jiR). 

Definition. A priority-based routing poUcy nj^^j)} is said to be a critical f -policy if R(t) = Trj{Q{t)). 

Example 3. Consider the network of four nodes given in Example |2] Note that ({2}, {1}, {3}), ({2}, {3}, {1}), and 
({2}, {1,3}), are not critical. Fig. [3] shows the structure of the cones {Z)^(i?)}flg7j^ where TZc is the set of all critical rank 
orderings of {1,2.3}, and f{m,n) — - Note the difference with Fig. 2(b) depicting {Z?/(i?)}ji;g7j. 




Fig. 3. Structure of the critical cones for the network of Example |2] 

Next we state the main results of this paper. 
E. Overview of the Results 

Theorem 1. Let f be a bivariate function that satisfies conditions (CI) and (C2). Then the associated f -policy (critical 
f -policy) is throughput optimal. 

Theorem [T] introduces a new class of throughput optimal routing policies. The sketch of the proof is provided in section 
[in] with the details provided in the appendix. 

Definition. Let n{^(t)} and n'|jj„^jjj be two priority-based routings. We say n'|^,jj^j respects !!{ ^(t)} if R'{t) is a refinement 
of R{t) for all time slots t. 

Theorem 2. Suppose Ilj^jf)} is a priority-based routing policy that is throughput optimal. Any priority-based routing policy 
that respects II^^jj-)} is also throughput optimal. 



Note that Theorem |2] enables the proof of throughput optimality of specific routing policies. For example, in section IV-B 
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Theorems [T| and |2] are used to prove the throughput optimahty of two known routing pohcies, backpressure [8] and ORCD 
[7]. The proof of Theorem |2] is simple and is given in Appendix |F] 

III. THROUGHPUT OPTIMALITY OF /-POLICY 

In this section we assume that routing decisions ^go, are made under an /-policy for which / is a bivariate 

function satisfying conditions (CI) and (C2). In this setting we prove that /-policy is throughput optimal. The proof is based 
on the following corollary to Foster-Lyapunov Theorem. 

Fact 2. ( [13, Lemma4.1]) Let L* : M}\ M+ be a Lyapunov function. If there exist constants i? > 0, e > 0, such that for 
all time slots t we have: 

N 

E [L*{Q{t + 1)) - L*{Q{t))\Q{t)] < B -eY,Qk{t), 

fc=i 

then the network is stable, i.e, the time average queue backlog of all nodes remain finite. 

To prove Theorem[T[ we identify a class of Lyapunov functions that under the corresponding /-policy satisfy the conditions 
of Fact|2]for all arrival rate vectors A e int{&). In particular, we construct a piece-wise Lyapunov function, L*^ : M.^ M+, 
by assigning to each cone Df{R), R = (Ci, C2, . . . , Cm), a quadratic function of the queue backlogs: 

M 

L/(Q,i?) = 5]/(|C-i|,|a|)Q^,. 

Since the collection of cones form a partition of M.^, we can combine the above quadratic functions to arrive at a piece-wise 
quadratic function 

L}{Q) = Lf{Q,nf{Q)) = ^ Lf{Q,R)^Q^n,iR)}- (4) 

Reiz 

Lemma 3. L*(-) is continuous and dijferentiable. 

Note that the continuity and differentiability of £*(•) follow 1) the continuity and differentiability of the construction of 
Lf{-,R) inside the cone corresponding to R, as well as 2) the construction of penalty function on the separating hyperplanes 
at the boundary of Df{R). The details are given in Appendix [c| 

Next we provide the main steps in showing L* has a negative expected drift. 

Let us consider the Lyapunov drift when Q{t) e Df{R) for some R = (Ci, C2, ■ ■ ■ , Cm) G By Lemma |3j L*j:{-) is 
continuous and differentiable. Thus, we can write Lj{Q{t+ 1)) in terms of its first-order Taylor expansion around 
and we obtain 

L}{Q{t + l))-L}{Q{t)) 

= {Q{t + 1) - Q{t)) ■ VL}{Q{t)) + o{\\Q{t + 1) - Q{t)\\) 

M 

= E/dC*'"'!' |a|)2Qc.(t)(Qc.(i + 1) - QcM + o{\\Q{t + 1) - Q{t)\\) 
1=1 

M 

= l^^l) [Qc.(^ + 1) - - iQcAt + 1) - QcM^] + o{\\Q{t + i) - Q{t)\\) 

i=l 
M 

= E/(|C'-iUC,|)[Q^,(i+l)-Q2^^(t)]+o(||Q(t+l)-g(i)||). (5) 

i=l 



Lemma 4. Lef i? = (Ci, C2, . . . , Cm) e Tl and Q{t) e Df{R). We have 

Ql^{t + 1) - Ql^{t) < f3f - 2Qc.(t)(Mc.,o«tW - ficMt) - 
where j3f is a constant bounded real number. 

Now taking expectation from both sides of (jSj) and using Lemma |4] we obtain, 

V.[L){Q{t+\))-L){Q{t))\Q(t)\ 

M 

< Bf - 2^ \a\)QcM^ [m,o«t(i) - lic^Mt) - AcMlQit)] + o{\\Q{t + 1) - Q(t)ll), (6) 

1=1 

where Bf is a constant bounded real number. 

Lemma |5] below shows that under an /-policy the negative drift term in (|6| is bounded by the negative drift under any 
other set of routing decisions, including the stabilizing randomized rule {/iij given in Fact[T] 

Lemma 5. Let R = (Ci, C2, . . . , Cm) G Tl, Q(t) G Df(R), and let {lJ-ij{t)}i.jen represent routing decisions made under 
an f -policy. For any collection of routing decisions {^ij{t)}ij(z^, we have 

M M 

Y.f{\C^-\ IQDQc. W(Mc.,o„tW - /^c.,»(i)) > E /dc**"'!' \C^\)Qcm^^c.,out(t) - fic.Mt))- (7) 

1=1 4=1 

However, since A G int{6), there exists a positive vector e (vector of length N with all elements equal to e, e > 0) such 
that A + e e 6. Thus, from Fact [T] 

E[fic.^out{t) - f^c.Mt) ~ AcMQit)] > (8) 
Combining (|7]i and ^ with ([6]), we have 

M 

E[L}{Q{t + l))-L}{Q{t))\Q{t)] < Bf-2eJ2fi\C'~'\AC^\)QcM+o{\\Q{t+l)-Q{t)\\). (9) 



4=1 

Property (C2) of function /, however, implies that 



/(O, |Ci|) > fi\C'\, IC2I) > • • • > f{\C''-'\, \Cm\) > f{\C''\, 1) = f{N, 1). (10) 
Combining (|9]l and ( 10 1 gives that 



N 



E[L}{Q{t+l))-L}{Q{t))\Q{t)] < Bf-2ef{N,l)J2Qk{t) + o{\\Q{t+l)-Q{t)\\). (11) 

fe=i 

Since \\Q{t + 1) - Q(i)|| is bounded, there exists a constant, say B'j.-, such that Bf + o{\\Q{t + 1) - Q(i)||) < for all 
time slots t. Therefore, we can rewrite ([TT} as 



E [L}{Q{t + 1)) - L*f{Q{t))\Q{t)] < B'f - e'J^Qkit), 



fe=i 



where e' = 2ef{N, 1). Now from Fact|2] the proof of Theorem [T] is complete. 

Note that the proof of throughput optimality for critical /-policy follows similar lines above. 
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IV. /-POLICY AND THE DESIGN OF THROUGHPUT OPTIMAL ROUTING POLICIES 

A. The structure of the Lyapunov function far f -policy 

In Examples |2] and [3] we considered a network of four nodes and showed the structure of (critical) cones for that network. 
In this section we study the Lyapunov function as defined in Q for the same network. Fig. |4] illustrates routing decision 
cones Df{R) and the associated quadratic function L{-,R). 




Fig. 4. Structure of the Lyapunov function for tlie network of Example |2] 

As shown in Fig. |4j /-policy groups the queues based on their backlogs. In the central cone, all nodes belong to the 
same ranking class. The Lyapunov function in this cone is the squared sum of all queue backlogs and it is clear that the 
Lyapunov drift in this case is the same (and negative from Theorem [TJ for all non-idling routing policies. This property 
allows a routing policy to potentially deviate from backpressure decisions in order to arrive at a better delay performance. 
However, when one of the queues becomes relatively large in comparison to the other nodes' backlogs, the backlog vector 
falls in a cone in which the node with large backlog is in a separate ranking class. The Lyapunov function for this cone, 
now, is the squared queue backlog of the node with large backlog plus the squared sum of other queue backlogs and its 
negative drift is ensured only when packets are routed from the node with disportionately large backlog to other nodes. 
Similarly one can analyze the behavior of the Lyapunov function in other cones. 

It is important to observe that the Lyapunov function in cones 1,3,5,7,9, and 11, is a weighted quadratic function, 
closely related to the quadratic Lyapunov function associated with backpressure routing. As discussed in [14], this ensures 
the negative direction when leaving the subspaces of the form {Qi — 0}iei, for some / C {1, 2, . . . , TV — 1}. What is 
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significant in the structure of the Lyapunov function is this behavior together with the flexibility in choice of function /. 
In effect, function / determines the size of cones associated with various rank orderings, i.e. it provides flexibihty in the 
relative occupancy time spent in non-idling cone 13 versus backpressure-Uke cones 1,3,5,7,9, 11. 

B. Two Known Examples 

In this section we use Theorems [T] and |2] to prove the throughput optimality of two known routing policies, backpressure 
[8] and ORCD [7]. 

In the opportunistic variant of backpressure routing, DIVBAR [6], among the set of nodes that have received a packet 
transmitted by node i, one of the nodes with the largest positive differential queue backlog is selected as the next forwarder 
Therefore, backpressure is a priority-based routing policy H^jj^^t)} where Rb{t) is a partitioning of the nodes based on their 
queue backlogs, with smaller backlog meaning lower rank, i.e. Qi{t) < Qj{t) implies that i ^^^it) j policy is shown 
to provide throughput optimality [6]. Next we give an alternative proof. This is done by showing that for any bivariate 
function / that satisfies conditions (CI) and (C2), backpressure respects /-policy. In other words, we show that if node j 
has a lower rank than node k under any /-policy, then Qj < Q^. The proof is immediate using Lemma |8] in Appendix [A[ 

In the rest of this section, we give a brief description of another congestion-based routing policy, known as ORCD [7] 
and prove its throughput optimality. In [7], ORCD was introduced as an alternative to backpressure routing to improve its 
delay performance. However, the throughput optimality of ORCD remained unproven. 

ORCD is a priority-based routing policy n{jj^j^(j)} in which nodes are ordered according to a cost measure of congestion 
"down the stream" from each node i denoted by Vi{t). In other words, i ^^coit) j jf Vi{t) < Vj{t). The congestion 
cost measure for node i, Vi{t), can be calculated for each time slot t in a recursive manner using a stochastic variant of 
Dijkstra algorithm. The recursive procedure results in a vector [Vo{t),Vi{t), . . . ,VN{t)] that satisfies the following fixed 
point equation for all time slots t: 

Vo{t) = 0, (12) 

V^{t) = Q,it)+Y,PiS\i)imnVjit). (13) 

sen 

Next we prove the throughput optimality of ORCD by showing that ORCD respects critical /-policy corresponding to 
any bivariate function / that satisfies condition (CI) and for all rn > and ni, 712 > 



f{m + ni,n2) p., 

where Pmin = min{P(5|i) : i G ri,5 C n,P{S\i) > 0}. Note that, for instance, function f{m,n) = x^'iK"-!) ' ^ — 
1+ p ^ , is such a function. In other words, we show that ORCD respects the critical /-policy for all such /. Mathematically, 
for all j,kefl such that j ^'^/(Qt*)) fc, then j -(«c£>(t) k as well. Let 7r^(Q(i)) = (Ci, C2, . . . , Cm) & 7^c, and let k £ d 
and j E C"^^. We consider two cases. 

Case I. Node k reaches a node in C*~^ U {0}. 

We next show 

Vk{t)>Qkit)>^^^^^>V,{t). (15) 
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The first inequality in (15i is immediate from ([78]l. The second and third inequality follow from the arguments below. 



Lemma |9] in the appendix implies that 

On the other hand, since 7ry(Q(t)) is critical, there exist distinct intermediate nodes ji, j2, ■ ■ ■ , ji & C*^^ such that 



j — ^ ji — > j2 ^ ■ • • — ^ ji 0. Using Lemma 10 in the appendix recursively and noting that Vo(t) — 0, we have the 
following upper bound of Vj{t), 

F,W<^ + ^ + ... + ^<^^. (17) 

Pmin Pmin Pmin Pmin 



Combining ( 16 1 and ( 17 1 gives ( 15 i. 



Case II. Node k does not reach any node in C'^^ U {0}. 

Let Ci be the set of nodes in Ci that reach a node in C*^^ U {0}. All the paths from node k to the destination are 
through the nodes in Ci, hence, Vk{t) > min^^g^ Vm{t). However, from Case I, for each node j G C*^^ and m G Ci, 
Vm{t) > This completes the proof. 

V. Discussion and Future Work 

In this paper, we provided a large class of throughput optimal policies by considering a class of piece-wise quadratic 
Lyapunov functions. We also specialized our result to recover and prove the throughput optimahty of two known routing 
policies, backpressure and ORCD. 

In this paper we considered a single destination scenario and we assumed that the network topology as well as probability 
of successful transmissions were fixed. The generalization to the case of 1) multi-destination scenario and 2) ergodic time- 
varying network topology and transmission probabilities are believed to be also straight forward but remain as future areas 
of work. 

In this paper we provided a proof for throughput optimality of ORCD with centralized controller. Proving the throughput 
optimality of distributed version of ORCD is also an area of future research. 

Appendix 

A. Preliminary Lemmas 

In this section of the appendix we provide some preliminary lemmas which are useful in proving other lemmas of the 
paper. 

Leiiuna 6. Let R — (Ci, . . . , Q, Q+i, . . . , Cm) and R' — (Ci, . . . , Ci_i, Ci U Q+i, • • ■ i Cm) be two adjacent rank 
orderings. 

. If R<Q R', then 

f{\C'-\ |a|)Qc. < /(|C*"'|, |C,| + |C,+i|)(Qc. + Oc.+J < fi\C% |a+i|)Qc.+i. 
. If R' <Q R, then 

f{\C'-\ IQDQc. > f{\C''\ lai + |Q+i|)(Qc. + Qc.+J > fi\C% |C,+i|)Qc.+i. 

Proof: 
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Suppose B <Q R'. By definition, mf{R, R') = i and we have 

AfiQ,R,i)<AfiQ,R',i), 



or 



f{\C'-'l\C,\)Qc^<fi\C'-'l\a\ + \C,+i\)iQc,+Qc,^J. 



(18) 



(19) 



Using (19 1 and property (CI) of function /, however. 



> 



1 



1 



f{\c^-^,\a\ + \a+i\) f{\c^-'\Aa\) 



/(ic-i| + iai,ia+ii) 



/(|C-i| + |a|,|C.+i|) 



Combining (19 1 and (20i completes the proof for the case R <q R'. 
Now suppose R' <Q R. By definition, we have 

Af{Q,R,i)>Af{Q,R',i). 

The rest of the proof follows ([19]) and ^2U[ identically. 



(20) 



Lemma 7. Let R = (Ci, C2, . . . , Cm) eU (ore 71^) and Q e Df{R) [or Q e D'j{R)j. Then 
/(|C'-i|, \a\)Qc^ < \C,+i\)Qc.^, z = 1, 2, . . . , Af - 1. 

Proof: For all 1 < i < Af — 1, R'^ = (Ci, . . . , Ci_i, Q U C,;+i, C,;+2 ■ • • i C'm) is a one-step confinement of R. Note 
that if i? e 7^c C 7^ then R'^ e 7^c C 7^. Now, since Q eDf{R) (q e Dj{R)y we have i? <q R[ for alll < i < Af- 1, 
and from Lemma |6] we have the assertion of the Lemma. 



Lemma 8. Let R ~ (Ci, C2, . . . , Cm) G 7?. and Q G D f{R). For any node k in ranking class Ci, 

Proof: Consider i?' = (Ci, . . . , C,_i, {fc}, C, - {k}, C,+i, Cm)- Since Q e Df{R), we have R <q R' . Using 
Lemma |6) we have 



f{\C'-'\,l)Qk> f{\C'-'\,\C^\)Qc.■ 
On the other hand and since Q e Df{R), Lemma |7] implies that 

f{\c'-A,m 
fi\c^~A,\c,\) 

Summing over j = 1, 2, . . . , z — 1 yields 



Qc, >Qc, j = l,2,...,i~l. 



(21) 



(22) 



(23) 
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However, condition (CI) implies that 



1 1 1 1 



V - = V - = - = - (24) 



Combining ( 23 1 and p4|l, we obtain 



which together with (21 1 and condition (C2) completes the proof. 



Lemma 9. Let R ~ (Ci, C2, . . . , Cm) € TZc <^nd Q S D'j(R). For any node k in ranking class Ci that reaches a node in 
c^-i U {0}, 

Proof: Consider R' — (Ci, . . . , Ci_i, {fc}, Q — {fc}, C^+i, . . . , Cj\/). Note that R' is critical since i? is critical and 
node k reaches a node in C"^^ U {0}. Since Q E Dj{R), we have R <q R', which together with Lemma |6] gives, 

f{\C'-'\A)Qk> fi\C'-'\,\C,\)Qc^. (26) 

The rest of the proof is similar to the proof of Lemma |8] and is omitted for brevity. 

■ 

B. Proof of Lemma [7] 

Lemma [1] Let bivariate function J satisfy conditions (CI) and (C2). Then for all Q G M.^, there exists a unique R E TZ 
such that Q G Df{R). 
Proof of Existence: 

The proof is done by induction. Let n denote the total number of nodes in the network excluding the destination. For 
n ~ 1 there exists only one rank ordering and the proof for this case is trivial. Now suppose for n < — 1 and for any 
Q e M" there exists a rank ordering R such that R <q R' for all R' G A{R). For n ^ N and for any Q G M^, using the 
procedure below, we will constructively show that there exists a rank ordering R such that Q G Df{R). 

I. Leti?o = ({l,2,...,^}). 

2. 

2.L Initialize 1 = 1. 

2.2. Is there a rank ordering R of the form R = (Ci, (72), \Ci \ = N - I, \C2\ = I, such that R <q RqI 

2.3. If yes, go to step 3. Otherwise, go to step 2.4. 

2.4. ; = / + L Is / < iV? 

2.5. If yes, go to step 2.2. Otherwise, Q G -D/(i?o)- 

3. Consider nodes in class Ci of rank ordering R. Since \Ci\ < N, by the assumption of the induction, there exists 
a rank ordering for the nodes in Ci such that it penalizes Q less than all its adjacent rank orderings. Let R* = 
(Ci*, C2*, . . . , C;^_i) be this rank ordering. Let R*^ = (0^,0^,. . . , Clj) = (0^,0^,. . . , Cj^^.i, C2). Furthermore, 
let R* = (Ci, C2, . . . , CM-i-i,CM-i U . . . U Cm) denote the rank ordering generated by merging the last i classes 
of 
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4. Find m such that R* <q R*_i for for i = 1, 2, . . . , m, but <q R*n+v Claims [T] and |2] below estabhsh that 

Q e Dj{R*J. 

Claim 1. Rq <q R' for all R' e Bi{Rl). Moreover, for i = 1, 2, . . . , M — 1, nodes in C*^i have larger queue backlogs 
than nodes in U^^^C*. 

Claim 2. Let R = (Ci, . . . , C^, C^+i, . . . , Cm) and R = (Ci, . . . , Ci_i, U C^+i, Ci+2, . . . , Cm)- Suppose following 
assumptions hold: 

1) R <Q R' for all R' e Bi{R). 

2) For any k e C^+i and fc' e Ci, Qk > Qk'- 

3) R<qR. 

Then ^ <q i?' for all i?' e 

By Claims Tj2 and using the fact that R* <q R*_i i = 1,2, ... ,m, we can recursively show that R* <q R' for all 
R' e Bi{R*), for i = 1, 2, . . . , TO. By construction, we also know that R'^ <q Moreover, i?*^ penalizes Q less than 

its one-step confinements with regard to C* , i ^ 1, 2, . . . , to — 2, since R* <q R' for all R' E B2{R*). Hence, <q R' 
for all R' e A{R*^), and by definition, Q e Df{R*^). 

Proof of Claim^ Note that following results are immediate using Lemmas |7j|8] and the fact that R* <q R' for all 
R' e Bi{R*): 

• i?5 penalizes Q less than all its one-step refinements with regard to ranking class C* for i — \,2, . . . ,M — \. 

• Nodes in C*^i have larger queue backlogs than nodes in U^^j^C* for i = 1, 2, . . . , M — 2. 
What is left to prove Claim [T] is to show that: 

1) i?o penalizes Q less than all its one-step refinements with regard to ranking class C]J^. 

2) Nodes in C^^ have larger queue backlogs than nodes in U*£^^C*. 

Let R = {CI, C2 , . . . , C2/_i, A, B) be a one-step refinement of R^ with regard to C\j, i.e. A\J B = Clj. Note that 
ufir^C* = Ci and Clj = 62 ■ Suppose R <q R*^. By Lemma [ej we have 

f{\C,\, \A\)Qa < |C2|)Qc. < /(It'll + 1^1: I^DQs. (27) 

On the other hand, since R <q Ro, by Lemma |6j we have 

/(0,|(7i|)Q^^ </(|C'i|, 1(721)0^.- (28) 



Combining (27i and ( [28] l, and using property (CI) of function /, we obtain 



f{0,\Ci\ + \A\) \f{0,\C,\) f{\C,\,\A\)J 

>Qc,+Qa- (29) 

After proper arrangement we have 

/(O, + |A|) (q^^ + Qa) < /(|Ci| + |A|, \B\)Qb, (30) 
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which implies that rank ordering {Ci U A,B) penalizes Q less than Rq. But this is a contradiction (look at step 2 of the 
given procedure and note that \B\ < \C2\ )• Therefore, Rq penahzes Q less than all its one-step refinements with regard to 
ranking class C^.j. 

Now consider node k G C^j and let R = (C*, , . . . , Cli_^, {k}, C^j — {k}). From the result of the previous part, 
Rq <q R. By Lemma |6] we have 

/(|Ci|,l)Qfc>/(|CiUC2|)Qc^. (31) 



Combining ( 28 1 and ( 3 1 1, we have 



Qk > ffl^Q^ > Qr , (32) 
where the last inequality follows from property (C2) of function /. Hence, nodes in C'^ have larger queue backlogs than 



nodes in ufs^^C*. 



Proof of Claim [2j 

It is sufficient to show that R penalizes Q less than its one-step refinements with regard to Ci U Ci+i. 

Let i?i — (Ci, . . . , Ci^i, AuC, BUD, Ci^2, ■ ■ ■ , Cm) be a one-step refinement of R where A, B, C, D are sets of nodes 
satisfying d = AUB and C,+i = C(JD. Then we can write i? and ^ as i? = (Ci, . . . , Cj_i, AUB, CUD, Cm) 
and i? (Ci, . . . , C,_i, A U B U C U D, C,+2, . • . , Cm)- Let i?i = (Ci, . . . , C,_i, A, B, C U i?, C,+2, . . . , Cm) and 
i?2 = (Ci, . . . , Ci_i, A U B, C, D, ■ • ■ , Ca/) be one-step refinements of R. Let J2]=\ \Cj\ = m, |^| = a, |B| = b, 
\C\ = c, and \D\ — d. We consider three cases based on sets B and C. 

Case I. B and C are not empty. 

Since R <q R2, by lemma [6j we have 

/(m + a + b, c)Qc > f{m + a + b,c+ d){Qc + Qd) > fim + a + b+ c,d)QD- (33) 
Let assume that Ri <q R. By lemma |6] we have 

/(m, a + c){Qa + Qc) < f{m + a + c,b + d){QB + Qd)- (34) 



After proper arrangement. 



/(m,o + c) 

Qb > -f, , , , , ,^ Qc - Qd- (35) 

/(to + a + c, + a) 



By property (CI) of function /, 

1 1 1 



f{m + a + c,b+d) /(m + a + Cjb) f{m + a + b + c,d) 



(36) 



Combining (33 1, (35 1, and ([36|l, we obtain 



Q ( /(TO,a + c) /(to + a + b,c) \ 

\f{m + a + c,b+d) f{m + a + b+c,d))^^ 
f{m, a + c) f{rn, a + c) — f(m + a + 6, c) 



^/(to + o + c, 6) /(to + a + 5 + c, d) 

By property (C2) of function /, 

f{m,a + c) 



(37) 



f( ^ ^ M ^ 1- (38) 
/(to -I- a + c, 0) 



By Property (CI) and (C2) of function /, 

2 

< 



f{m,a + c) f{m,a + c) f{m + a + c,b) 

1 



/(m, a + c+b) 
1 



1 



< 



f{m,a + b) f{m + a + b,c) f{m + a + b,c) 



(39) 



Combining (|37]), and we obtain 

Qb>Qc- (40) 
By assumption 2 of the lemma, queue backlog of any node in set C is larger than Qa + Qb- But this is in contradiction 



with (40 1. Therefore, assumption Ri <q R cannot hold and we have R <q Ri. 
Case II. B is empty. 

Since R <q R, we have the following inequality by lemma |6j 

f{m,a + b){QA + QB) > f{m + a + b,c+d){Qc + QD)- 



Using (33 I, (41 1, and the fact that £? = 0, we obtain following inequalities 

f{m + a,c)Qc > f{m + a + c,d)QD, 
f{m,a)QA > f{m + a + c,d)QD- 



By (42 1, (43 1, and property (CI) of function /, 

f{m,a + c){Qa + Qc) > f{m,a + c) 



f{m, a) f{m + a, c) 
f{m + a + c, d)QD- 



f{m + a + c, d)Q 



D 



By Lemma [H] R <q Ri. 
Case III. C is empty. 

Since R <q Ri, we have 



/(to, a)QA > f{m, a + b){QA + Qb) > f{m + a, b)Qi 



Using (34 1, (45 i, and the fact that C = we obtain following inequalities 

f{m,a)QA > fim + a,b)QB, 
f{m,a)QA > fim + a + b,d)QD- 



Combining (46 1 and ( |47] i, we obtain 

Qb + Qd < fim, a) 



1 



1 



f{m + a,b) f{m + a + b,d) 
f{m,a) 



Q, 



f{m + a,b + d) 



Q, 



By Lemma |6] R <q Ri. 



(41) 

(42) 
(43) 



(44) 



(45) 

(46) 
(47) 



(48) 



Proof of Uniqueness: 
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Consider R = {Ci, C2, . . . , Cm} and R = {Ci, (72, • ■ • , Cj^^}. We will show that Q cannot be in Df{R) and Df{R) 
simultaneously. 

Case I. There exist nodes a and b such that b a and a 6, i.e. 
If Q G by Lemma |8] we have 

Qa > Qc^-^ > Qb- 

Similai-ly, if Q G Df{R), by Lemma [s) we have 

Qb > Qci-^ — Qa- 



(49) 



(50) 



Clearly (49i and (50i cannot hold simultaneously. 

Case II. There are no nodes a, b, such that b <^ a and a <^ h. In this case, it is not difficult to see that, there exist n, 
n < M, consecutive classes C^+i, . . . , Ci+„ G R, and Cj G R such that for some sets of nodes Ai, A2, Bi, . . ., i3„, the 
following relationships hold 

a+k =Bk 2 < fc < n - 1 , 

Ci+n = Bn U A2 

and 

where . . ., i?„ are non-empty while Ai and could be empty. 

In rank ordering R, C* and Ai have lower rank than UjJ^g^fc- Because of the condition of Case II, none of the nodes in 
U Ai can have a higher rank than a node in U}J^2^fc under rank ordering R. Hence, we have 

C'UAi = C^~\ (51) 
|C^| + |Ai| = (52) 

Furthermore, 

= \C^ + \A,\ + \UlzlBk\ 

n-l 

= + (53) 

k=l 

Now suppose Q G Df{R). Let i?i = {Ci, . . . ,Ci, Ai, Bi,Ci+2, . ■ . ,Cm} and i?2 = {Ci, . . . , Ci+„_i, J5„, A2, Ci+„+i, 
. . . , Cm} be one-step refinements of R. Since Q ^ Df{R), R <q Ri and R <q i?2. By Lemma|6] we have 

/(|C^|C,;+i|)Qc.+, > /(IC'I + IAiUBiDQb,, (54) 

/(|C'+""iUB„|)gs„ > /(|C»+"-iUa+„|)Qc,^„, (55) 

where equality in (54i and (55 1 hold when Ai and A2 are empty respectively. Moreover, since Q G Df{R), by Lemma |7] 
we have 



f{\C% |Cfe+i|)Qc.+. > f{\C'-'\, \Ck\)Qc, k=l,2,...,M-l. 



(56) 
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Combining (54l-(56l, we obtain 

\B„\)Qb„ > fi\C'\ + \Ail \B,\)Qb,. 



(57) 



However, we also have assumed that Q E Df{R). Let Ri — {Ci, . . . ,Cj-i, Bi,U2^2^k,Cj+i, ■ ■ ■ ,Cj([} and R2 



{Ci, . . . , Cj-i, UjJ^^Sfc, Bn, Cj+i, . . . , Cm'} be one-step refinements of R. By Lemma |6] we have 

n n 

/(|(7^"-i|,^|Bfe|)^QB. < fi\C=-'\,\Bi\)QB,, 



k=i fc=i 

n-l 



f{\c^-^\ + j2\B,\,\Bn\)QB^ < n\c="'\,j2\B,\)j2QB. 



k=l 



fc=l fc=l 



whose direct consequence is 



n-l 



fi\C'-'\ + \Bn\)QB,. < f{\C'-'\, \B^\)Qb,. 



Substituting (52i and (53 1 in (60 1, we obtain 

|i?„|)QB„ < f{\C'-'\ + \A,\, \B,\)Qb,, 



(58) 
(59) 

(60) 

(61) 



which contradicts (57 1. Therefore, Q cannot be in Df{R) and Df{R) simultaneously. 



C. Proof of Lemma |i] 

Lemma |3] L*{-) is continuous and differentiable. 

Proof: For all R E TZ, L{-,R) is a simple quadratic function in Q. Hence, to prove continuity and differentia- 
bility of L*{-), it suffices to show that ) is continuous and differentiable at any Q on the hyperplane separating 
Df{R) and Df{R'), for any adjacent rank orderings R — (Ci, . . . , Q+i, . . . , Cm) and R' = (Ci, . . . , Ci_i, Q U 
Ci+i , Ci+2 , • • • , Cm ) ■ 

The hyperplane separating Df{R) and Df{R') is given by Af{Q,R,i) — Af{Q,R' From Lemma |6] this hyperplane 
can be written as 



f{\c'-'\, \a\)Qc^ = f{\c'-'\, lai + \a+i\){Qcu + Qc^^j = f{\c'\, \a+i\)Qc^^,. 



(62) 



On one side of this hyperplane, L*{-) — L{-, R), and on the other side, L*{-) — L{-, R'). For any Q on this hyperplane, 
L(Q,i?) - L(Q, R') = f{\C'-\ \C,\)Q% + f{\C% \C,+^\)Ql^^, - f{\C'-\ \C,\ + |Q+i|)(Qc. + Qc.+J' 

= 0, (63) 



where the last equality follows from (62 1. Equation (63 1 implies that L*{-) is continuous on the hyperplane separating Df{R) 
and Df{R'). 

Similarly, to prove the differentiability of L*{-), we have to show that L{-,R) and L{-,R') have same partial derivatives 
at any Q on the hyperplane separating Df{R) and Df{R'). We have, 
dL{Q,R) 



dQk 



= 2/(|CJ-i|, IQDQc, for all fc e j = 1, 2, . . . , M, 



(64) 
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and. 



dL{Q,R') 2f{\C^-WC,\)Qc, 



for all k G Cj, j i,i + 1 



9Qk I 2/(|C'-iUa| + |C,+i|)(Qc, +Qc,+J for all e U a,+i 

From (|62|i,(|64j, and ( |65| l, we have 

VL{Q,R) = VL{Q,R'). 



(65) 



(66) 



In a similar way we can show continuity and differentiability of £*(•) on the hyperplanes separating any other two adjacent 
cones, and this completes the proof. 



D. Proof of Lemma |4] 

Lemma |4] Let i? = (Ci, C2, . . . , Cm) e TZ and Q{t) e Df{R). We have 

QlM + 1) - Qc. W <Pf~ 2gc.(t)(m,o«t(t) - m,»«(t) - AcM, 

where Pf is a constant bounded real number 
Proof: 



For all d, let aCi.R '■— /([ci-ii \c \) - Q'^i — ^Ci.R^ then for any node k e d, by (|21 



we have 



Let a = max/j.gK niaxc,efl "c,,fl,- 

If (^) > a, then using (j2| we obtain 

+ 1) < - Aic„o«t(t) + m,m(i) + ^c.(i). (67) 

After taking the square of both sides of ( [67] i and appropriate arrangements of terms, we have 

< iV' + A^2(l + A™,,)2-2Qc.(t)(Mc.,out(t)-Aic.,»n(t)-Ac.(i)). (68) 

If Qc, (t) < a, then 

QcAt + '^)<QcM + i^c.Mt) + M{t)- (69) 

This implies that, 

Qc.(*+ 1) - QqW < (m.m(t) + Acu{t)f + 2Qc,{t)tic^^ouf{t) - 2Qc,{t){^^c„out{t) - - ^c.W) 

< N\l + A^axf + 2aN-2QcMi^^c^,outit)-^ic,Mt)-AcAt))■ (70) 



Let /?/ := _^ ^2(^^ _^ A,nax)^ + 2aN. From (68 1 and (70i we have 

Qhit + 1) - Qc. W < /3/ - 2gc.(t)(Mc.,o«t(t) - fic-Mt) - AcM- 
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E. Proof of Lemma |5] 

Lemma jsj Let R = (Ci, C2, . . . , Cm) G T^, Q{t) G Df{R), and let {^^ij{t)} i^jt^n represent routing decisions made under 
an f -policy. For any collection of routing decisions {/iij(i)}ijGf2, we have 



M M 



Y.f{\C^~\ m)QcAtWc.,out{t) - /^C.,»(0) > E /d^'^'l' m)QcM{l^C.,out{t) - ^iC..,n{t)). (71) 



i=l 



Proof: Switching the sums in the right-hand side of (71 1 and using ([T]l, we have 

M 



i=l 

M , M 



= J2J2 EEm«W [fi\c^-'\AQ\)QcM-fi\C'-'\AC,\)Qc,(.t)]+^,koit) fi\c^-AAa\)QcM 

i=i ked ^j=i leCj 
M , 

^ E E ( i^^ax,^^^10es.(t).o^5.(0} {^{\G'-\\c^\)QcXt)-!{\c'-\\cmc,(t)\ 



<j<M leCj 

+ Moes,m fi\c^-'im)QcMy (72) 

iince Q{t) e Df{R), by Lemma |7] we have 

\C,\)QcAt) < /(l^^l, |Q+i|)Qc.+, W * - 1,2, ... ,Af - 1. (73) 



However, from ( 73 1, the upper bound in d72b can be achieved if routing decisions are made such that fiu = 1 only when 



I € Sk{t) and I m for all m e Sk{t). This is how exactly /-policy makes routing decisions. Hence, /-policy maximizes 



the right-hand side of (71 1 over all collections of routing decisions. 



F. Proof of Theorem |2] 

Theorem|2] Suppose Il{ji.{t)} '■s ^ priority-based routing policy that is throughput optimal. Any priority-based routing policy 
that respects nifli-j-)} is also throughput optimal. 

Proof: Suppose n'|^,(.j^j is a priority-based routing policy that respects H^jK^^-jy Let S*{t) = {k £ Si{t) : k ^^(*) 
j for all j e S,{t)} and Sf (t) ^ {k e S.,{t) : k j for all j e S,{t)}. Since R'{t) is a refinement of R{t), Sf (t) is a 

subset of S*{t). By definition of the priority-based routing, Il'^j^,^^^^ selects one of the nodes in S* (t) as the next forwarder. 
Since 5* (<) C S*{t), this routing decision is consistent with n^/jj^f)}, hence, guarantees throughput optimality. ■ 

G. Lemma 17 01 

Lemma 10. For any two nodes a and b, if a ^ b, then 

Va{t)<^ + V,{t). (74) 

Pmin 

Proof: Define Ua{t) := {a' : a ^ a' and Va'{t) < Va{t)}. Assume Ua{t) = {ai, 02, . . . , a/c} such that Va^it) < 
Vat+i (i), * = 1, 2, . . . , ii' — 1. Furthermore, let 

p{a,t) := E ^75) 

5:Snt/„(t)#0 

p(a,a^,^) E ^(-^l^)" ^^6) 

S:a,eS,Va,{t)<Vj{t) VjGS 
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From ( [T3] l we have, 

K 

Va{t) = Qa{t)+Y,p{a,a„t)VaM + {l-p{a,t)) Va{t). (77) 

i=l 

After appropriate arrangement of the terms, we obtain 

yait)-^,+f:'-^VaM. (78) 

p{a,t) ^ p(a,t) 



If Va{t) < Vb{t), then clearly (74 1 holds. So in what follows, we assume Va{t) > Vb{t). Since a ^ b, b e Ua{t). Without 



loss of generality assume that Vb(t) — Ki (t). From (78 i we have 



Noting 



p{a,t) ^ p{a,t) p{a,t) 



^ p{a,ai,t) ^ p{a,ai,t) ^ p{a,ai,t) ^ ^ 
^ p{a,t) p(a,i) p(a,i) " ' 



along with (79 1, we obtain 



Va{t) < . +VaAt)<^+VaM, (81) 



_ Qa{t) , ^ Qa{t) 

^3 

where the second inequality holds because ^Yl^^^]^p{a^a^^t) > p. 
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